Grounding Acoustic Echoes in Single View Geometry Estimation
نویسندگان
چکیده
Extracting the 3D geometry plays an important part in scene understanding. Recently, robust visual descriptors are proposed for extracting the indoor scene layout from a passive agent’s perspective, specifically from a single image. Their robustness is mainly due to modelling the physical interaction of the underlying room geometry with the objects and the humans present in the room. In this work we add the physical constraints coming from acoustic echoes, generated by an audio source, to this visual model. Our audio-visual 3D geometry descriptor improves over the state of the art in passive perception models as we show in our experiments.
منابع مشابه
Experimental Results of Underwater Cooperative Source Localization Using a Single Acoustic Vector Sensor
This paper aims at estimating the azimuth, range and depth of a cooperative broadband acoustic source with a single vector sensor in a multipath underwater environment, where the received signal is assumed to be a linear combination of echoes of the source emitted waveform. A vector sensor is a device that measures the scalar acoustic pressure field and the vectorial acoustic particle velocity ...
متن کاملApplication of Model-Based Estimation to Time-Delay Estimation of Ultrasonic Testing Signals
Time-Delay-Estimation (TDE) has been a topic of interest in many applications in the past few decades. The emphasis of this work is on the application of model-based estimation (MBE) for TDE of ultrasonic signals used in ultrasonic thickness gaging. Ultrasonic thickness gaging is based on precise measurement of the time difference between successive echoes which reflect back from the back wall ...
متن کاملDynamic rayed aurora and enhanced ion-acoustic radar echoes
The generation mechanism for naturally enhanced ion-acoustic echoes is still debated. One important issue is how these enhancements are related to auroral activity. All events of enhanced ion-acoustic echoes observed simultaneously with the EISCAT Svalbard Radar (ESR) and with high-resolution narrow field-of-view auroral imagers have been collected and studied. Characteristic of all the events ...
متن کاملAcoustic echoes reveal room shape.
Imagine that you are blindfolded inside an unknown room. You snap your fingers and listen to the room's response. Can you hear the shape of the room? Some people can do it naturally, but can we design computer algorithms that hear rooms? We show how to compute the shape of a convex polyhedral room from its response to a known sound, recorded by a few microphones. Geometric relationships between...
متن کاملAcoustic proximity ranging in the presence of secondary echoes
Proximity ranging is very important in many applications. Ultrasonic sensors have proven to be very cost effective tools for this purpose. Most of the currently available time-of-flight based acoustic proximity ranging systems use the conventional matched filter based time delay estimation approaches to measure short distances between proximity objects. However, in the presence of strong and cl...
متن کامل